TITLE OF THE INVENTION 

Recording Medium and Method for Reproducing Information 
therefrom 



BACKGROUND OF THE INVENTION 

The present invention relates to a technique for recording/reproducing 
picture information, in particular still picture information, on/from a recording 
medium. 

5 FIG. 2 shows an example of the conventional arrangement of 

information files that are stored on an optical disk, such as a DVD (Digital 
Versatile Disc), where moving picture information is recorded. In the 
information file structure shown in FIG. 2, a directory DVR is formed on the 
optical disk. Each information file is recorded under this directory. 

10 In FIG. 2, the info.dvr file 201 is a file where information such as the 

number and filenames of play lists under the DVR directory is written. The 
menu.tidx file 202 is a file where information such as the sizes and information 
amounts of thumbnails to be used in menus is recorded. The menu.tdat file 
203 is a file where thumbnail picture information to be used in menus is 

15 recorded. The mark.tidx file 204 is a file where information such as the sizes 
and information amounts of thumbnails associated with mark positions are 
recorded. The mark.tdat file 205 is a file where thumbnail picture information 
to be used at mark positions is recorded. Play list files 206 are files where 
marks and other information specifying in what order and what parts of picture 

20 information are to be reproduced are recorded. Clip information files 207 are 
files where information such as play start points in stream files and their 
packet positions is recorded. Stream files 208 are files where such packets 
as picture information and sound information are recorded. 
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With respect to the stream files 208, picture information is 
compressed according to the MPEG2 standard, which is one of the standard 
picture information compressing techniques, and the compressed information 
is converted into a stream file before being recorded. MPEG2 provides an 
5 excellent ability to compress a large amount of information not only to NTSC- 
format picture information, but also to HD (High Density) picture information, 
such as Hi-Vision. The amount of information in original picture information 
can be compressed to about one tenth or one fiftieth. For example, picture 
information in the NTSC format is compressed to about 6 Mbps, while HD 
10 picture information is compressed to about 20 Mbps. In both cases, MPEG2 
can attain a sufficiently high picture quality. Picture information compression 
by MPEG2 is widely used in such applications as accumulation of picture 
information on DVDs and digital broadcasting. 

With respect to the clip information files 207, in the same manner as 
15 described above, picture information is compressed according to the MPEG2 
format before being recorded. The MPEG2 system compresses picture 
information based on correlations between adjacent pictures. More 
specifically, if there are portions which do not change between adjacent 
pictures, information relating to these portions is not transmitted again, and 
20 the last picture information received is used as it is for these portions. 

However, this imposes a drawback in that not all picture information elements 
can be reproduced by decoding such picture infonnation, only the changed 
portions of which were encoded. After such an operation as fast forward or 
skip, play can be restarted only from those pictures in which all picture 
25 information elements were encoded. 

Generally, when picture information compression is performed 
according to the MPEG2 standard, picture information is divided into groups, 
each comprising about fifteen pictures. Each of these groups is called a 
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GOP (Group of Pictures). Play from the top of a GOP allows immediate 
reproduction of picture information. 

In the clip information file 207, the packet position of the top of each 
GOP is recorded with the time (corresponding to the Presentation Time Stamp 
5 value) indicating when its picture information was encoded. This makes it 
possible to easily find a play start position when a search or skip operation is 
performed. 

Clip information files 207 are associated with stream files on a one-to- 
one basis. If a clip information file designated 01000x1 pi is recorded in 

10 association with a stream file designated 01000.m2ts, these files can easily 
be recognized as being associated with each other. 

With respect to the play list files 206. information recorded in each 
play list file lists parts of stream files which are to be played in the specified 
order. FIG. 3 more specifically shows the information structure of the play list 

15 files. In a play list file, the version_number entry indicates the version of the 
play list. The PlayList_start_adclress entry indicates where the play list 
information is recorded in the play list file. The PlayListMark_start_address 
entry indicates where the play list mark information is recorded. The 
MakGrsPrivateData__start_address entry indicates where the maker's private 

20 information is recorded. Note that each play list contains information about 
one or more play items, indicating what parts of stream files are to be played. 

An example of, the play list mark information will be described in detail 
with reference to FIG. 7. The length entry indicates the information length of 
the play list mark information. The numberjof_PlayUstMarks entry indicates 

25 the number of play list marks. The markjtype entry indicates the type of the 
play list mark. The mark_namejength entry indicates the length of the play 
list mark's name. The ref_to_PlayltemJd entry indicates the number of the 
play item associated with the play list mark. The mark_time_stamp entry 
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indicates the time when the play list mark was marked. The EntryJESJPID 
entry indicates the packet ID of the ES (Elementary Stream) of the play item 
associated with the play list mark. The refjtojthumbnailjndex entry 
indicates the number of the thumbnail associated with the play list mark. The 
5 mark__name entry stores a character string representing the name of the play 
list mark. 

An example of the stream management structure of moving picture 

information will be described with reference to FIG. 13. As shown in FIG. 13, 

a stream is composed of plural titles and a title is composed of plural chapters. 
10 Each chapter is composed of plural scenes. In many cases, each scene is 

constituted by moving picture information that has been recorded continuously 

until recording is stopped after having been started. 

With reference to FIG. 7 and FIG. 13, the types of play list marks will 

be described. Each play list mark may have be any of one of several 
15 identifiable types; for example, a title mark indicates the top of a title, a 

chapter mark indicates the top of a chapter and a skip mark indicates the top 

of a scene. 

With reference to FIG. 8, an example of how the play list information, 
play item information, clip information, stream files and play list mark 

20 information are mutually associated will be described. Each play list includes 
one or plural play items. In this example, two play items 802 and 803 are 
shown a part of play list 801 . Each play item specifies what part of what 
stream file is to be played by designating the corresponding clip information's 
filename, STC_sequence number, start time and stop time. More specifically, 

25 the play item 802 is associated with an area 804 of a stream file. 

Each play item may be associated with a different stream file. 
Reference numerals 806 and 807 respective indicate positions where play list 
marks are recorded. Actually, these play list marks are recorded in the play 
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list information and are converted to packet positions in the actual stream file 
by using the clip information. (For example, see Japanese Patent Laid-Open 
No. 2003-123389.) 

The above-mentioned technique assumes that moving picture 

5 information is recorded and reproduced using MPEG stream files. However, 
it is necessary to record/reproduce still picture information as well as moving 
picture information. In addition, unlike moving picture information, when still 
picture Information is to be reproduced, it is desirable to allow each still picture 
to be accessed easily. When reproducing a plurality of still pictures from a 

10 recording medium, the user is required to perform operations for such 
purposes as to switch to the previous or next picture. 

Since the recording/reproducing of still picture information is not taken 
into consideration in the conventional recording and reproducing apparatus, 
however, the apparatus can not operate properly in response to the above- 

15 mentioned operations by the user. In addition, a method for displaying still 
picture information while outputting sound information continuously as BGM 
(Background Music) has not been taken into consideration. 

It is an object of the present invention to solve the above-mentioned 
problems, that is, to allow still picture information to be easily selected and 

20 reproduced and to provide a user-friendly reproducing technique. 

SUMMARY OF THE INVENTION 

To solve the aforementioned problems, the present invention provides 
a recording medium on which the following information is recorded: a plurality 
25 of picture information sets; presentation time values, each of which is 

associated with a corresponding one of the picture information sets; picture 
information record marks, each of which is associated with a corresponding 
one of the presentation time values; and reproducing order specifying 
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information which specifies in what order the picture information sets are to be 
reproduced. 

In addition, the present invention provides a technique for reproducing 
information from a recording medium on which the following items are 

5 recorded: a plurality of picture information sets; presentation time values, each 
of which is associated with a corresponding one of the picture information 
sets; picture information record marks, each of which is associated with a 
corresponding one of the presentation time values; clip information which 
specifies what position on the recording medium is associated with each of 

10 the presentation time values; and reproducing order specifying information 
which specifies in what order said picture information sets are to be 
reproduced. The and picture information is reproduced through the following 
steps: detecting the presentation time value of a picture information set to be 
retrieved from the corresponding picture information record mark; using said 

15 clip information to detect the recording position on the recording medium 
which corresponds to the detected presentation time value; and reproducing 
picture information from the detected recording position. 



BRIEF DESCRIPTION OF THE DRAWINGS 
20 FIG. 1 is a block diagram of a reproducing apparatus with which the 

present invention is carried out; 

FIG. 2 is a diagram which shows an example of the structural 
arrangement of files on a recording medium; 

FIG. 3 is a diagram which shows an example of the data structure of a 
25 play list file; 

FIG. 4 is a diagram which shows an example of the data structure of 
play list information; 

FIG. 5 is a diagram illustrating the information provided by a 
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typejof_presentation entry; 

FIG. 6 is a diagram which shows an example of the data structure of 
play item information; 

FIG. 7 is a diagram which shows an example of the data structure of 
5 play list mark information; 

FIG. 8 is a diagram which shows how information is mutually 
associated when moving picture information is recorded; 

FIG 9 is a diagram which shows how information is mutually 
associated when still picture information is recorded; 
10 FIG. 10 is a diagram which shows how information is mutually 

associated when BGM-combined still picture information is recorded; 

FIG. 11 is a diagram which shows the format of a MPEG-TS; 

FIG. 12 is a block diagram of an output timing control circuit; and 

FIG. 13 is a diagram which conceptually shows an example of a 
15 stream management structure; 

FIG. 14 is a diagram which shows how information is mutually 
associated when still picture information is recorded; and 

FIG. 15 is a diagram which conceptually shows the content of a play 

list file. 

20 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The following description is direction to a first embodiment of the 

present invention. 

Although it is assumed in the description of this first embodiment that 
25 a DVD is being used as a recording medium, the present invention can also 

be applied to the use of a CD (Compact Disc), MD (Mini Disc) and various 

other information recording media. 

It is also assumed in the following description that intra frame 
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compressed picture information (I pictures) is included in recorded MEPEG 
stream files (hereafter denoted simply as stream files) according to the 
MPEG2 standard. Needless to say, information can be encoded by another 
picture information compression method as well. 

5 Similar to picture information, sound information is compressed in 

terms of quantity by using a sound information compression technique in this 
first embodiment. The employed sound information compression technique 
is selectable from a variety of compression systems, such as the MPEG1 
audio system and the AAC system that is used in BS digital broadcasting. In 

10 addition, since the amount of sound information is smaller than that of picture 
information, it can be recorded by a linear PCM method without compression. 

In addition, in this first embodiment, picture information and sound 
information, which are encoded as described above, are multiplexed into a 
stream file and recorded as a single file so as to facilitate transmission and 

15 accumulation. More specifically, each information unit is converted into a 
188-byte packet, which is given a PID (Packet ID) to identify the packet. 
Giving a unique PID to each unit of information allows packets to be sorted 
easily when they are reproduced. 

In first embodiment, not only picture and sound information, but also 

20 subtitle information, graphic information, control command information and 
other information packets can also be multiplexed into a stream file. Further, 
such packets as PMT (Program Map Table) and PAT (Program Allocation 
Table) packets, which define how PIDs are associated with each other, and a 
PGR (Program Clock Reference) packet indicating time information are also 

25 multiplexed. A stream file where information is multiplexed in this way is 
recorded on an optical disk as a stream file. 

A reproducing apparatus according to the present invention will be 
described with reference to FIG. 1 . 
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In FIG. 1. an optical disk 101 has information recorded thereon, and 
an optical pickup 102 reads out information from the optical disk 101 by using 
laser light. In a reproducing signal processing circuit 103, the signal that has 
been read out through the optical pickup 102 is subjected to prescribed 

5 decoding processing, and it is converted to a digital signal. In an output 
control circuit 1 04. the digital signal from the reproducing signal processing 
circuit, where decoding processing was performed, is packetized according to 
a prescribed format, and it is then subjected to output processing. A servo 
circuit 105 controls the rotating speed of the optical disk and the position of 

10 the optical pickup 1 02. A drive control circuit 1 06 controls the servo circuit 
105 and the signal processing circuit 103. 

in an audio information decoder 107, a sound information signal is 
obtained by decoding sound information packets received from the output 
control circuit 104. An audio output terminal 108 outputs the sound 

15 information signal which was obtained through decoding by the audio 
information decoder 107. In a video information decoder 109, a picture 
information signal is obtained by decoding picture information packets 
received from the output control circuit 104. A video output terminal 110 
outputs the picture information signal which was obtained through decoding 

20 by the video information decoder 109. 

On the optical disk 101. stream files are recorded, in which picture 
information and sound information signal packets are multiplexed. In 
addition, such information as play list information, which lists items to be 
reproduced in the listed order from streams, clip information, which locates 

25 characteristic points in each stream, mark position information, which 

indicates skip positions and chapter start positions, and menu information, 
that is used to select a play list, are recorded as files in a prescribed format. 

Each play list information file has information about one or plural play 
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items, indicating what parts of what stream files are to be reproduced. 

FIG. 4 shows an example of the data structure of the play item 
information in the first embodiment. In the play item information, the length 
entry indicates the length of the play items. The typejofjpresentation entry 

5 indicates how the items are to be presented. The number_of_Playltems intry 
indicates the number of play items in the play item information. The 
number_of_SubPlayltems entry indicates the number of sub play items (Sub 
play items will be described later in connection with a third embodiment. 
FIG. 5 shows the meaning of the values which the 

10 type__of_presentation can have. More specifically, if type_of_presentation 
entry is 0, the play items are reproduced as ordinary moving or still picture 
information. If the type_of_presentation entrt is 1, they are reproduced as 
still picture information with BGM. Note that still picture information with 
BGM will be described in detail later in connection with a third embodiment. 

15 FIG. 6 shows an example of the data structure of the play item 

information. The length entry indicates the information length of the play 
item. The still_flag entry is a flag indicating whether the presentation is to be 
frozen at the end of the play item reproduced. If the still_flag entry is set, the 
still^du ration entry specifies in seconds how long the presentation is to be 

20 frozen at the end of the play item being reproduced. When the entry 

stilljdluration-0, this specifies that the presentation is to be frozen infinitely. 
The ClipJnformationJ[ile_name entry represents the file identifier of the 
corresponding dip information file and stream file. The ref_to_STCJd entry 
indicates the sequence number of the STC in the stream file. The IN_Jime 

25 entry specifies where the play item begins in the stream file by designating the 
corresponding PTS in the picture information. The OUTJtime entry specifies 
where the play item ends in the stream file by designating the corresponding 
PTS in the picture information. 
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In the first embodiment, play items are respectively associated with 
individual still pictures, as shown in FIG. 14. On the other hand, as described 
with the conventional technique, in the case of moving picture information, it is 
not feasible to associate every I picture with a play item since this 

5 tremendously enlarges the size of the play list file. Thus, play list mark 
information is recorded at the top of each chapter, as shown in FIG. 8. By 
using such marks, it is possible to realize various functions, such as to start 
reproduction from the next chapter and to go back to the top of the current 
chapter and start reproduction therefrom. In the case of still picture 

10 information, however, it is desirable to associate each still picture with a play 
item. When switching to the previous or next still picture, this allows the still 
picture to be detected easily. 

As described, in connection with the first embodiment, a plurality of 
still pictures can be recorded in such a manner that such operations as 

15 switching to the next or previous picture can be implemented easily. 

Now, a second embodiment of the present invention will be described. 
Although the description thereof is based on some assumptions, these 
assumptions will not be specifically mentioned, since they are the same as 
those made in the description of the first embodiment. 

20 The second embodiment is characterized in that each still picture is 

associated with a mark. That is, in the second embodiment, a still picture 
mark, which indicates the top of a still picture, is added as another type of play 
list mark to the syntax shown in FIG. 7. Accordingly, each play list mark is 
recognizable, for example, as either a chapter mark indicating the top of a 

25 chapter, a still picture mark indicating the top of a still picture or a skip mark 
indicating the skip position of a scene. 

The meaning of each mark can be recognized if the mark is given 
prescribed numbers assigned to the type of mark. This allows plural marks 
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of the same type to be used selectively. Needless to say, it is possible not 
only to give any meanings to marks, but also to use only one mark type. 

In the second embodiment, if the position of each still picture is 
recorded as a play list mark, it is possible to easily detect the position of the 

5 objective still picture when switching to the previous or next still picture is to 
be performed. For reference, FIG. 15 conceptually shows the play list 
management structure in the second embodiment. 

With reference to FIG. 9. an example of how each item of information 
is associated when still picture information is recorded will be described. 

10 When still picture information is recorded, it is recorded as picture 

information instead of moving picture information, in the case of still picture 
information, picture information is not recorded continuously, but only where 
still picture information is to be reproduced. Meanwhile, such information as 
sound information and subtitle information is recorded continuously on a 

15 stream whether the information is associated with still picture information or 
moving picture information. 

Similar to moving picture information, the still picture information to be 
recorded is picture information that has been compressed according to the 
MPEG2 format and is recorded as a file in the form of a MPEG transport 

20 packet. Unlike moving picture information, however, only one intra frame 
compressed picture (I picture) is recorded as still picture information. Since 
the information is terminated at the end of the picture information, adding a 
sequence end code to the picture information allows the decoder to display 
and hold one picture, 

25 FIG. 11 conceptually shows a MPEG transport packet. The stream 

from the output control circuit 104 is output in the form of this MPEG transport 
packet. 

In FIG. 11 , reference numeral 1101 designates a packet header and 
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1102 designates a MPEG transport packet. The MPEG transport packet is 
188 bytes long. Plural consecutive packets, each with a 4-byte packet 
header, are recorded as a stream file. Of the packet header, 30 bits are used 
as a time stamp and the remaining 2 bits are used as an area to record 

5 additional information. The time stamp is used to control the output timing of 
the packet. Its value is determined by counting based on a 27 MHz clock. 
FIG. 12 shows a specific example of a portion of the output control circuit 104 
that is configured to control the packet output timing. The circuit portion 
includes an input terminal 1201, a buffer 1202, a time stamp pickup circuit 

10 1203, an oscillator 1204, a counter 1205, a coincidence detector 1206 and an 
output terminal 1207. 

The signal retrieved from an optical disk is supplied to the input 
terminal 1201 of the output timing control circuit as a MPEG transport packet. 
As shown in FIG. 11, this incoming MPEG transport packet has a 4-byte 

15 packet header. The time stamp pickup circuit 1203 extracts a 30-bit time 

stamp from the packet header of the MPEG transport packet and supplies it to 
the coincidence detector 1206. Concurrently, the packet is stored in the 
buffer 1202. 

Meanwhile, the oscillator 1204, which generates a clock signal having 
20 a frequency of 27 MHz, supplies this clock signal to the counter 1205. The 
counter 1205 is 30 bits long, the same as the time stamp, and it counts the 27 
MHz clock pulses. The result of the counting by the counter is supplied into 
the coincidence detector 1206. 

An example of how reproduction is performed in a reproducing 
25 apparatus according to the second embodiment will now be described with 
reference to Fig. 1. 

On an optical disk 101. picture information streams, play list 
information, clip information, etc. are recorded in the aforementioned formats. 
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Initially, the user sets the optical disk 101 into the reproducing apparatus. 
Once the optical disk is inserted, the drive control circuit 106 detects the 
presence of the inserted disk and, by sending a signal, notifies the system 
control circuit 111 that a disk has been inserted. Upon receiving the disk 

5 insertion signal, the system control circuit 111 reads out file management 
information from the optical disk 101 . More specifically, the system control 
circuit 111 instructs the drive control circuit 106 to read out information from a 
prescribed sector of the optical disk 101 . According to the instruction 
received from the system control circuit 111, the drive control circuit 106 

10 controls the servo circuit 105 to control the rotating speed and phase of the 
optical disk and the position of the optical pickup 102. Accordingly, the 
optical pickup 102 seeks out the specified sector and reads out information 
therefrom by laser light. 

The laser light received by the optical pickup 102 is converted to an 

15 electrical signal by a photoreceptive circuit, and the electrical signal is sent to 
the reproducing signal processing circuit 103. The reproducing signal 
processing circuit 103 converts the electric signal to digital information by 
performing decoding, error correction and the like on the signal. The 
information read out in this manner from the prescribed sector is sent back to 

20 the system control circuit 111 via the drive control circuit 106. Based on the 
information received from the drive control circuit 1 06, the system control 
circuit 111 analyzes the file management information and the contents of the 
read out files. The recorded file management information includes the 
directory, identifier, size and location of each file recorded on the optical disk 

25 101. Using the file management information, the system control circuit 111 
reads out the necessary files. 

Then, the user instructs the reproducing apparatus to start playing the 
optical disk 1 01 . More specifically, the user pushes the play start button on a 
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remote controller (not shown). The signal transmitted from the remote 
controller is received by the remote control receiver 112 and supplied to the 
system control circuit 111 . Recognizing the signal as the play start command 
from the user, the system control circuit 111 reads out a file info.dvr 201 to 

5 acquire the number, filenames, etc., of play list files recorded on the disk. 
The system control circuit 111 displays the acquired play list information on 
the picture information screen, urging the user to select a play list. The 
embodiment may also be configured in such a manner that menu picture 
information is displayed with thumbnails. 

10 The user selects a desired play list from the play lists displayed on the 

TV picture information screen. This selection is effected by pushing a button, 
such as the upward, downward, rightward or leftward buttons on the remote 
controller. Via the remote control receiver, the system control circuit is 
notified as to which button has been pressed. Of course, this play list 

15 selecting operation is not necessary if the user intends to play the top play list. 

Once a play list is selected, the system control circuit 111 reads out 
the selected play list information from the optical disk. Each play list includes 
a type_of_presentation entry, representing information indicating how play is 
to be performed. It also includes play item information indicating what parts 

20 of what stream files are to be played by designating the corresponding 
filenames and play start and end times. In addition, play list mark 
information is also written. The play list mark information includes the 
numbers given respectively to the play item and thumbnail associated with 
each marked time. 

25 As example of how the reproducing apparatus operates when the 

type_of_presentation entry is 0, that is, when ordinary play is to be performed, 
will be described. 

If the type_of j:)resentation entry is 0. files specified as play items will 
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be played sequentially. More specifically, the system control circuit 111 reads 
out the top play item information and reads out a clip information file 207 
associated with the ClipJnformationJTile entry written there. Then, by using 
the clip information, the times designated in the INJtime and OUTJtime 

5 entries that are written for the play item are converted to the corresponding 
packet start number and end number. Then, a stream file associated with 
the CIlpJnformationJTile entry is read out so as to replay it from the packet 
associated with the packet start number. Retrieved stream packets are 
output from the output control circuit 104 to the audio decoder 107 and video 

10 decoder 109 at the prescribed timings according to the time stamps written on 
the packets. 

In the audio decoder 107, sound information is decoded and output to 
the sound information output terminal 108. Similarly, in the video decoder 
109, picture information is decoded and output to the picture information 

15 output terminal 110. in addition, subtitle information, graphic information and 
the like are decoded in prescribed decoders (not shown) and superimposed 
on the picture information signal to be output. Commands multiplexed into the 
stream are supplied from the output control circuit 104 to the system control 
circuit 111 where the commands are interpreted. 

20 The stream file is replayed until the packet which is given an end 

packet number associated with the OUTJtime entry for the play item 902 is 
reached. After the end packet is replayed, the next play item 903 begins to 
be replayed similarly. Once the play items listed in the play list 901 all have 
been played, the reproducing apparatus goes back to the play list selection 

25 stage. Needless to say, the system control circuit 111 may also be modified 
in such a manner that, in this case, the next play list begins to be played 
continuously. 

An example of how the skip operation is treated while picture 
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information is being reproduced will be described. 

As described earlier, play list mark information is included in the play 
list 901 . Each play list mark is associated with a play item and indicates the 
time when the mark was recorded. While the play item 901 is being replayed, 

5 if the next chapter button on the remote controller is pushed by the user to 
replay the next chapter, the play list mark Information associated with the 
current play item is read and a chapter mark 910 which exists later than the 
current replay time is retrieved as a skip mark. 

In the description of the second embodiment, it is assumed that each 

10 play item corresponds to a chapter and that the top still picture mark of each 
chapter serves also as a chapter mark, although this should not be construed 
to limit the scope of the present invention. The present invention may also 
be implemented in such a manner that an arbitrary picture group is associated 
with a play item and still picture marks are set separately from chapter marks. 

15 In addition, if another skip mark is not found in the play list mark information 
associated with the current play item, the play list mark information associated 
with the next play item may be searched. 

The time of the chapter mark 910 that is retrieved in this manner is 
acquired from its markjtime_stamp entry and the corresponding play start 

20 packet number is determined from the clip information. Then still picture 
information 905 begins to be reproduced from that packet. This allows the 
next chapter to be played in response to actuation of the next chapter button. 

Similariy, if the previous chapter button is pushed to restart replay 
from the next previous chapter, the play list mark information associated with 

25 the currently replayed item is read to find a skip mark which is older than the 
current replay time. If there is no older skip mark in that play list mark 
information, the play list mark information associated with the next previous 
play item may be searched. The time of the skip mark retrieved in this 
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manner is acquired from its mark_time_stamp entry, and the corresponding 
play start packet number is determined from the clip information. Then the 
stream file begins to be replayed from that packet. This allows the next 
previous chapter to be replayed in response to actuation of the chapter button. 
5 In this way, a stream can be replayed from before and after a play list mark 
position. 

An example of picture information switching operations (skip, etc.) will 
be described. 

In FIG. 9, the play list 901 includes two play items 902 and 903. If 

10 the play list 901 begins to be replayed, still picture information 904 and its 
accompanying information 907, such as sound information, included in the 
play item 902, are replayed at first. The still picture information 904 is 
immediately displayed if the stream begins to be replayed. Meanwhile, the 
accompanying information 907 is a stream having a predetermined length, 

15 and it is displayed over a predetermined period of time (for example, 5 
seconds). This replay period was determined when the information was 
prepared. After the play item 902 is replayed, the play item 903 is replayed. 
The play item 903 includes two still pictures 905 and 906, along with 
accompanying sound and other information 908. If the play item 903 begins 

20 to be replayed, the still picture information 905 is immediately displayed, and, 
after expiration of a predetermined period of time, the still picture information 
906 is displayed. During this time, the accompanying information 908 
continues to be output. When the accompanying information 908 reaches to 
its end time, replaying the play item 904 is completed. 

25 If the next picture button is pushed to display the next still picture 

information while the still picture information 905 is being replayed, the system 
control circuit retrieves the next picture mark 911 from the play list mark 
information and begins to replay the stream from the position given by the 
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mark 911 , that is, the still picture information 906. The accompanying sound 
and other information 908 is multiplexed with the still picture information 
stream. If the displayed still picture information changes, the accompanying 
information being output also changes. Accordingly, replay of the 

5 accompanying information 908 is restarted from the position associated with 
the still picture information 906, that is, the still picture mark 911 so that the 
remaining part of the accompanying information 908 is replayed. 

Similarly, if the previous picture button is pushed to display the 
previous still picture information while the still picture Information 905 is being 

10 replayed, the system control circuit picks up the next previous picture mark 
909 from the play list mark information and begins to replay the stream from 
the position given by the mark 909, that is, the still picture information 904 and 
accompanying information 907. 

As described so far, the user can easily switch the displayed picture 

15 information. In addition, the stillJRag and still_duration entries can be set to 
play items. They are used to freeze picture information for a certain period of 
time at the end of a play item that is being replayed. For example, the play 
item 902 will be frozen for 10 seconds at its end if the stilljlag entry is set and 
the value 10 is assigned to the stilljduration entry. The system control circuit 

20 recognizes that the stilljlag entry is set for the play item 902 after the play 
item 902 is replayed, and freezes the display. More specifically, the system 
control circuit stops the output of the sound information and continues to 
display the last picture information. Then, the system control circuit starts 
replaying the next play item after 10 seconds have passed. Thus, the display 

25 can be frozen for an arbitrary period after play item replay. If the next picture 
button is pushed while the display is frozen, replay may be restarted from the 
position of the next still picture flag. If the stilljduration entry is set to 0. 
replay is controlled so as to freeze the display until some operation is 
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performed by the user. This processing, combined with command 
processing, can be applied to. for example, menu selection by the user 

As shown in FIG. 6, since the still_flag entry is set on an each play list 
basis in the play list information structure of this embodiment, only the last 
5 picture information of each play item can be frozen. To allow picture 
information during a play item replay to be frozen, the play item must be 
divided into separate play items or the syntax must be modified so that the 
still Jlag and stilljduration entry information can be set more than once for 
each play item. 

10 Note that, although the stream associated with the play list 912 in the 

example of Fig. 6 has only still picture information and does not contain sound 
and other accompanying information, the play list 912 also allows the same 
replay and skip operations as the play list 901 . In addition, if every I picture 
of moving picture information is associated with a mark in the same manner 

15 as still picture information, switching to another I picture can be performed 

easily when moving picture information is displayed as still picture information. 

As described so far, plural still pictures recorded in the second 
embodiment can be easily switched to either display the next picture or a 
previous picture. Also, when moving picture information is displayed as still 

20 picture information, switching to either the next or the previous picture can be 
performed easily. 

A third embodiment of the present invention will be described with 
reference to Fig. 10. In the second embodiment described above, if the 
displayed still picture information is switched due to a skip operation or the 

25 like, the accompanying sound information is switched as well. However, it is 
preferable to continuously output sound information without a break, for 
example, while a menu is being displayed for selection or while stilt picture 
information is being displayed like a photo album. Accordingly, as shown in 
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FIG. 10, BGM sound information is recorded as a sub play item separately 
from the ordinary play items. FIG. 10 shows how information is mutually 
associated when BGM-combined still picture information is replayed. 

If still picture information has been multiplexed with sound and other 

5 information before being recorded, as shown in FIG. 9, switching the 
displayed picture information to another picture as instructed by the user 
results in switching not only the picture information, but also the associated 
sound and other accompanying information. This is not always desirable, for 
example, when a menu screen is to be displayed using still picture information. 

10 Accordingly, the third embodiment is configured in such a manner that even 
when picture information is switched, sound information can be replayed 
continuously without a break. 

More specifically, as shown in FIG. 10, a play list includes not only a 
plurality of still pictures specified as ordinary play items, but also sound 

15 information specified as a sub play item. Since this allows the sound 

information to be replayed independently of the still picture information, the 
sound information can be replayed continuously even when the displayed still 
picture is switched. 

In view of the information syntax, a play item can be defined as BGM- 

20 combined still picture information by specifying typejof_presentation = 1 in 
the play list information. 

An example of how BGM-included information, as shown in FIG. 10, is 
replayed will be described. 

To replay still picture information with BGM, the entry 

25 type__of_presentation is set to 1 . In a play list 1001 , a sub play item 1010 is 
included with two play items 1002 and 1003. More specifically, the audio 
stream 1011 is specified as SubPlayltemQ according to the information syntax 
in FIG. 6. Here, the stream corresponding to the play items includes subtitle 
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information, graphic information and control commands, as well as picture 
information, but does not contain sound information. Meanwhile, the sub 
play item stream 1011 contains only sound information. 

When the play list 1001 is to be replayed, information about the play 

5 items (1002 and 1003) and the sub play item 1010 is acquired from the play 
list (FIG. 4). Then, a clip information file is read out according to the 
ClipJnformation_file_name entry in the play item (FIG. 6). Using this clip file 
information, the stream replay start packet number associated with the time 
specified in the INJtlme entry is obtained. Further, the stream file associated 

10 with the clip information file is read in to output and decode picture Information 
starting from the packet having the replay start packet number. The streams 
1004, 1005 and 1006 replayed here as play items include picture information 
and subtitle information, but they do not contain sound information. Or, even 
if sound information is included, control is carried out so as to abort the sound 

15 information without outputting it. The play items in the play list 1001 are 
replayed through this processing procedure. 

Meanwhile, the sub play item 1010 is also specified in the play list 
1001 . If the type__of_presentation entry is specified as 1 in the play list 
information, the system control circuit in the reproducing apparatus judges 

20 that this play list includes the replay of sfill picture information with BGM. In 
this case, the sub play item is to be treated as BGM sound information. 
More specifically, a stream 1011 corresponding to the sub play item 1010 is 
read in and control is performed so as to repeatedly replay this stream. Of 
course, this control may be modified so as to replay the sub play item stream 

25 only once. It is also possible to allow the number of times replay is repeated 
to be specified/recorded for the sub play item. Note that the sub play item 
must be replayed concurrently with a play item. For example, time division 
processing makes it possible to read in and replay/output both stream files 
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concurrently. Of course, the same result can be obtained by reading the 
whole sub play item into a prepared large capacity buffer memory in advance. 

Then, on the assumption that the recorded information is structured 
as shown in FIG. 10, an example of how the replayed still picture information 

5 is switched when instructed by the user will be described. 

As described earlier, if the play list 1001 is selected, the play items 
1002 and 1003 will be replayed sequentially to output still picture information. 
Concurrently, the sub play item 1010 will also be replayed to output sound 
information from the stream 1011. 

10 If the next picture button is pushed by the user to display the next still 

picture while the stream 1005 is being replayed, the system control circuit 
retrieves the next still picture mark 1009 from the play item marks and restarts 
replay at that position. Thus, the replayed still picture information is switched 
to display the still picture information contained in stream 1006. Meanwhile, 

15 the sub play item 1010 continues to be replayed independent of the user's still 
picture switching operation. Thus, the stream 1011 can be replayed to 
continuously output sound information without a break even when the 
replayed picture information is switched as instructed by the user. 
The information structure shown in FIG. 10 also allows the 

20 still j)icture_flag and still^duratlon entry to be used to freeze the display of 
each picture information for an arbitrary period after being replayed. Also, in 
this case, it is possible to prevent sound information from breaking if control is 
carried out so as to continuously output the sub play item 1010, I.e., the BGM 
sound information. 

25 In the third embodiment, as described so far, by using a sub play item 

as BGM sound information, it is possible to continuously output sound 
information even when the replayed image information is switched by the user. 
Note that, although in the specific example mentioned above, two 
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types of play list marks (chapter marks and still picture marks) are selectively 
used, this should not be construed to limit the implementation of the present 
invention. It is also possible to use play list marks of the same type. In this 
case, it is possible to perform appropriate processing based on the result of 

5 judging whether the picture information being replayed is ordinary moving 
picture information or still picture information. 

As described, in accordance with the third embodiment, a plurality of 
recorded still pictures can be easily switched to display either the next picture 
or a previous picture. In addition, it is possible to continuously output sound 

10 information as BGM while still picture information is displayed. 

More particularly, the present invention makes it possible to easily 
switch reproduced still picture information and provides a user-friendly 
reproducing technique. 

Although the present invention has been described in terms of 

15 particular embodiments, other embodiments can also be implemented without 
departing from the spirit and scope of the present invention. The particular 
embodiments as described herein are merely examples and are not to be 
construed as limiting, in any way, the scope of the present invention. The 
scope of the present invention should be assessed in accordance with the 

20 appended claims. Further, the scope of the present invention encompasses 
all changes and modifications which are equivalent to the subject matter of 
the appended claims. 
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